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DEVICE FOR PROCESSING IMAGE DATA AND AUDIO DATA 



(54) [Title] 

(57) Abstract 
Purpose 

To present a digital electronic camera with which 
links can be established among more than 1 image, 
audio, and text files; and expressions that are correlated 
with one another among the image, audio, and text files 
can be edited and recorded easily. 

Constitution 

A device for processing image data and audio 
data, characterized as being equipped with recording 
medium 101 that records image data and audio data by 
correlating them, specification means 203 that specifies 
audio data stored in recording medium 101, control 
means 1 3 that retrieves image data that are correlated 
with the specified audio data in the form of file 
information, and reading means 102 that reads the 
retrieved image data and plays them back. 
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Claims 

1 . A device for processing image data and audio data, characterized in that it is equipped 
with a recording medium that records image data and audio data by correlating them, 

a specification means that specifies audio data stored in the aforementioned recording 
medium, 

a control means that retrieves image data that are correlated with the aforementioned 
specified audio data in the form of file information, and 

a reading means that reads the aforementioned retrieved image data and reproduces them. 

2. The device for processing image data and audio data described in Claim 1, 
characterized in that it is further equipped with a character recognition means that performs 
character recognition of the aforementioned image data, whereby it performs registration 
processing so as to record the result of recognition by said character recognition means in the 
form of a text file by correlating it with the aforementioned respective image and audio data 
while allowing it to be retrieved. 

3. The device for processing image data and audio data described in Claim 1, 
characterized in that it is further equipped with a speech recognition means that recognizes the 
aforementioned audio data in the form of characters, whereby it performs registration processing 
so as to record the result of recognition by said speech recognition means in the form of a text 
file by correlating it with the aforementioned respective image and audio data while allowing it 
to be retrieved. 

4. The device for processing image data and audio data described in Claim 1, 
characterized in that it is further equipped with a display means that displays the aforementioned 
respective data stored in the aforementioned recording medium in the form of file information, 
whereby mutually correlated information among the aforementioned respective files is edited, 
and the results of retrieval of the aforementioned respective data based on said correlated 
information are displayed. 
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Detailed explanation of the invention 
[0001] 

Industrial application field 

The present invention pertains to a device that processes image and audio so as to record 
and play them. 

[0002] 
Prior art 

A still video format has been known as a standard for processing and recording image 
and audio data. In the case of said conventional still video format, image data and audio data are 
FM-recorded separately on different tracks. In addition, the audio track is provided with a field 
that is used to record the track number of a correlated image track in its control code and is used 
to record a note (identification information) regarding a specific image. 

[0003] 

Problems to be solved by the invention 

However, the aforementioned conventional digital electronic camera has the following 
problems. 

© That is, with the still video format, although an image track to be looked up from an 
audio track could be specified, the correlated audio track could not be looked up from the image 
track. Thus, there was the shortcoming that it was highly inefficient and impractical because in 
order to establish a definite relationship between audio data and image data, all the tracks on a 
still video floppy serving as a recording medium had to be searched to play all the audio tracks 
until an image track to be looked up was found, which inevitably took an enormous amount of 
time. 

[0004] 

© In addition, because only one image could be looked up from an audio track, when 
multiple images were involved, a single audio [track] could not be correlated with them. 
Therefore, there was the problem that an oral comment regarding a common concept could not 
be added to multiple images at one time. 

© Furthermore, because a large recording capacity was required to record audio data, 
there was a problem that, for cost reasons, it was especially inappropriate to use an audio track 
for a simple comment. 
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[0005] 

Here, the problems pertaining to the aforementioned conventional digital electronic 
camera are also problems with a popular device that is used to process audio and image data. The 
present invention was thus made in view of the aforementioned problems, and its objective is to 
present a device for processing image data and audio data that is configured such that links can 
be established among plural image, audio, and text files to allow the respective files to be 
retrieved and reproduced mutually in order to allow expressions that are correlated with one 
another among the image, audio, and text files to be recorded and edited easily. 

[0006] 

Another objective is to present a device for processing image data and audio data, 
wherein sound or an image can be converted into a text format, so that a comment (identification 
information) can be added to the image using a small capacity. Yet another objective is to 
present a device for processing image data and audio data that allows the text that is added as a 
comment to be used for running a search and used as a keyword when generating a database. 

[0007] 

Furthermore, another objective is to present a device for processing image data and audio 
data by means of which such processing as automatic linking of data with information stored in 
another database can be realized. 

[0008] 

Means to solve the problems 

In order to solve the aforementioned problems so as to achieve the objectives, the device 
for processing image data and audio data of the present invention is characterized in that it is 
equipped with a recording medium that records image data and audio data by correlating them, a 
specification means that specifies audio data stored in the aforementioned recording medium, a 
control means that retrieves image data that are correlated with the aforementioned specified 
audio data in the form of file information, and a reading means that reads the aforementioned 
retrieved image data and reproduces them. 

[0009] 

In addition, it is preferably characterized in that it is further equipped with a character 
recognition means that performs character recognition of the aforementioned image data, 
whereby it performs registration processing so as to record the result of recognition by said 
character recognition means in the form of a text file by correlating it with the aforementioned 
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respective image and audio data while allowing it to be retrieved. In addition, it is preferably 
characterized in that it is further equipped with a speech recognition means that recognizes the 
aforementioned audio data in the form of characters, whereby it performs registration processing 
so as to record the result of recognition by the aforementioned speech recognition means in the 
form of a text file by correlating it with the aforementioned respective image and audio data 
while allowing it to be retrieved. 

[0010] 

In addition, it is preferably characterized in that it is further equipped with a display 
means that displays the aforementioned respective data stored in the aforementioned recording 
medium in the form of file information, whereby mutually correlated information among the 
aforementioned respective files is edited, and the results of retrieval of the aforementioned 
respective data based on said correlated information are displayed. 

[0011] 
Function 

Because the device for processing image data and audio data of the present invention is 
configured in the aforementioned manner, links can be established among more than one image, 
audio, and text file so as to allow the respective files to be retrieved and reproduced mutually, 
and expressions that are correlated with one another among the image, audio, and text files can 
be edited and recorded easily. 

[0012] 

In addition, because an audio or an image file can be converted into a text format, a 
comment (identification information) can be added to the image using a small capacity. In 
addition, the text that is added as a comment can be used for running a search and used as a 
keyword when generating a database. Furthermore, processing such as automatic data linking 
with information stored in another database can be realized. 

[0013] 

Application example 

A preferred application example of the present invention will be explained in detail 
below with reference to attached figures. Figure 1 is a block diagram showing the configuration 
of a digital electronic camera of the present application example. In Figure 1, a memory card or a 
hard disk in compliance with the PCMCIA standard, for example, is used as recording medium 
101. An audio jack and a speaker are used as audio input circuit 20 and audio output part 22, 
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respectively. A/D converter 24 is a device for converting an audio signal from an analog signal 
into a digital signal; and D/A converter 25 is a device for converting a digital audio signal sent 
from signal processing control CPU 13 into an analog signal. Switch 21 is a selection circuit for 
selecting when an audio signal is to be transmitted to audio output part 22. Memory bus 
controller 102 is used for transferring image data and audio data among pickup signal processing 
part 19, DSP 13 for signal processing control, image display buffer memory 12, and recording 
medium 1/F circuit 104. 

[0014] 

D/A converter 26 is a device for converting digital image data from image display buffer 
memory 12 into an analog video signal, and video output part 23 is a video display device for 
displaying the analog-converted video signal as an image. 1 is a pickup lens, 2 is a diaphragm- 
shutter with a diaphragm function as well as a shutter function, 3 is a flash, mechanism-operation 
part control CPU 4 controls respective operating parts used for mechanical operations, and driver 
circuit 5 is a circuit for driving the respective mechanical components. 

[0015] 

Pickup element 6 is a CCD for converting light reflected from a photographic object into 
an electric signal, timing signal generator circuit 7 (hereinafter to be referred to as "TG") 
generates a timing signal that is needed to operate pickup element 6. Pickup element driver 
circuit 8 is a driver circuit for amplifying the signal from timing signal generator circuit 7 to the 
level at which an imaging signal can be driven, and preprocessing circuit 9 is equipped with a 
CDS circuit for removing output noise generated by pickup element 6 and a non-linear amplifier 
circuit to be operated before A/D conversion. A/D converter 10 converts the preprocessed data 
into a digital signal. CPU 13 for signal processing control is a signal processing control DSP 
(Digital Signal Processor) for controlling the signal processing part, operation display part 14 is 
a display part for providing indications to assist operations and show given camera statuses, and 
operation part 15 is an input device such as a keyboard that is used to control the camera from 
the outside. Recording medium I/F 104 is an I/F circuit used to connect the digital electronic 
camera based on the present application example with recording medium 101. Then a file format 
such as MS-DOS can be used as a recording file format with the recording medium of the 
camera of the present application example. 

[0016] 

Image display buffer memory 12 can be accessed from DSP 13 for signal processing 
control by pixel units, and any arbitrary operation means panel can be drawn while displaying a 
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pickup image. When a trackball is installed in operation part 15, a user I/F similar to the GUI 
(Graphical User Interface) of personal computers of recent years that utilizes a pointing device 
can be realized. That is, DSP 13 for signal processing control draws a variety of control panels in 
the image display buffer, and a user operates the pointing device (trackball in this case) on the 
control panels, whereby all types of camera operations can be performed. In addition, images, 
text, and a variety of diagrams are drawn at the image display part by DSP 1 3 for signal 
processing control in order to present the current camera status and all types of information, for 
example, management information regarding files in the recording medium, to the user. In the 
present application example, operations of the operation part 15 and aforementioned GUI-based 
user I/F will hereinafter be referred to as operations by operation part 1 . In addition, a click or a 
double-click operation with the pointing device will be referred to as an activation operation. 

[0017] 

Monitoring of image recording in image recording mode 

When DSP 13 for signal processing control detects a recording mode transition command 
that is entered by the user via operation part 15, DSP 13 for signal processing control executes 
the following processing in order to display a recording image on video output part 23. 
Mechanical operation part control CPU 4 and mechanical system driver circuit 5 are used to 
control the lens system as intended by the photographer. In such a case, photographing 
conditions are displayed on operation part 15 in order to inform the photographer of the camera 
status. Furthermore, a photometry circuit, not shown, is used to measure the brightness of the 
photographic object; and a value that indicates the opening of diaphragm-shutter 2 and shutter 
speed data is derived by the mechanical operation part control CPU 4. Diaphragm-shutter 2 is 
driven by mechanical system driver circuit 5 based on the control value derived by mechanical 
operation part control CPU 4. In addition, flash 3 may be activated, depending on the output of 
the not-shown photometry circuit. Exposure is performed as described above, and the light 
reflected from the object is incident on pickup element 6 via pickup lens 1 and diaphragm- 
shutter 2. In this case, diaphragm-shutter 2 is provided in order to regulate the amount of light 
incident on pickup element 6 and to prevent adverse effects of incident light on the signal charge 
while the image is being transferred when an interlaced read-type CCD is utilized as the pickup 
element. Pickup element 6 is operated based on a drive signal that is obtained by amplifying the 
output of TG 7 by pickup element driver circuit 8. Here, the operation of TG 7 is controlled by 
DSP 13 for signal processing control. The output of pickup element 6 driven in said manner is 
sent to preprocessing circuit 9. Preprocessing circuit 9 carries out CDS processing for removing 
low-frequency noise present in the output from the pickup element and processing for non- 
linearizing the pickup output in order to utilize the D range (digitized signal data) of A/D 



converter 10 effectively. The preprocessed pickup signal output is converted to a digital signal at 
A/D converter 10, and it is converted into standard component video signals (for example, a 
brightness signal and two color difference signals or an RGB signal) before they are input to 
memory controller 102. Memory controller 102 transfers the digitized pickup signals to buffer 
memory 12 continuously under the control of DSP 13 for signal processing control. 

[0018] 

Figure 2 is a diagram showing a display format used in the image recording mode. When 
displaying a display image output to image display part 23, monitor region part 202 for the 
recorded image and parameter control panel part 203, where camera status and photographing 
conditions can be configured by the user, for example, are divided as shown in Figure 2. The 
digital data in image display buffer memory 12 are converted into an analog video signal by A/D 
converter 26 and output to video output part 23, and display is performed at video output part 23. 
The user can confirm the recorded image at monitor region part 202 in the form of a moving 
image. 

[0019] 

The moving image captured by pickup element 6 is displayed at video output part 23 
through the aforementioned processing. 

Recording of image 

Once the camera is instructed to capture an image when operation part 1 5 is controlled by 
the photographer, DSP 13 for signal processing control stops displaying the moving image, 
accesses the image data held in the display buffer memory via the memory controller, applies 
digital compression processing, and records data on recording medium 101 via recording 
medium I/F 104. 

[0020] 

When memory bus controller 102 stops writing to image display buffer memory 12 for a 
prescribed interval of time after said transfer interval and recording is finished, the image to be 
recorded is displayed at video output part 23 as a still image. Thus, the user can confirm the still 
image that has just been recorded using video output part 23. In addition, once photographing is 
completed, to allow the content of the recorded image to be confirmed quickly, DSP 13 for 
signal processing control can add a thinned image, which is generated from the compressed 
image, to the compressed file. For example, the volume of the file does not increase very much 
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when an image is added that is thinned to approximately 1/8 of the original image dimensions in 
the horizontal and the vertical direction. Here, this image will be referred to as an index image. 

[0021] 

Monitoring and recording of audio during audio recording 

While in the recording mode, DSP 13 for signal processing control can monitor audio to 
be recorded by connecting the output of audio input circuit 20 to the input of audio output part 
22 using switch circuit 21. When DSP 13 for signal processing control detects an audio 
recording command that is entered by the user via operation part 15, DSP 13 for signal 
processing control receives the data that have been converted into digital data by A/D converter 
circuit 24, and transfers them to recording medium I/F 104 via memory bus controller 102. 

[0022] 

When DSP 13 for signal processing control detects cancellation of the audio recording 
command that is entered by the user via operation part 15, or when a prescribed amount of time 
has passed, DSP 13 for signal processing control assumes the cancellation of audio recording, 
and DSP 13 for signal processing control ends audio recording. 

Simultaneous recording of images and audio 

When recording images and audio simultaneously, as was already explained under 
<Recording images>, DSP 13 for signal processing control holds the audio data received from 
A/D converter 24 temporarily in an internal buffer of DSP 13 for signal processing control while 
the image is being compressed and transferred to recording medium I/F 104; it transfers the 
audio data to recording medium I/F 104 when the image transfer is completed. In the case of the 
NTSC format, what is called a vertical blanking interval, a 1 .4-millisecond interval where no 
video signal is present, is provided before and after the vertical sync interval that is part of the 
16.7-millisecond interval for 1 field. When image data are to be transferred at the normal video 
rate, image data that are not processed [sic] into a pickup signal are transferred during the time 
interval (approximately 15 milliseconds) that excludes said vertical blanking interval. The data 
are transferred at a rate of approximately 10 MBytes/sec to this end. 

[0023] 

When 1 8-bit sample of audio data is obtained at 22 kHz, the volume of data required for 
16.7 milliseconds is approximately 370 Bytes. When said data are to be transferred using the 
remaining 1 .4 milliseconds, a transfer rate of approximately 260 KBytes/sec is required. Said 
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speeds can be easily achieved when a memory card in compliance with the PCMCIA standard, 
for example, is used as a recording medium. 

[0024] 

As explained above, because the audio data are transferred during the vertical blanking 
interval out of the scanning interval of 1 screen, and the image data are transferred during the 
image interval by means of time-division multiplexing, the camera of the present application 
example can record images and audio simultaneously while monitoring them at the same time. 
Here, because the audio data can be assumed to be information correlated with an image, image 
and audio are filed such that they can be looked up mutually based on the explanation of 
<Linking audio and text to an image file> to be described later. 

[0025] 

In addition, the audio data may also be transferred during the horizontal blanking interval 
of the video signal. For example, when sampling audio under the conditions of 44.1 kHz, stereo, 
and 8 bits, a total of 6 bytes or 4 bytes of audio data are transferred and recorded during 1 
horizontal blanking interval (1 H interval). At this time, if a medium with a recording mechanism 
such as that of an HDD is used as a recording medium, the audio data should be recorded in an 
interleaved fashion at every 1H interval. However, when a semiconductor memory is used, there 
is no need to interleave the image data and the audio data at every 1H interval, and interleaved 
recording at every IV interval may be used in order to record the audio data before the image 
data in 1 field interval (IV interval). 

[0026] 

Recording of text data 

In the case of the camera of the present application example, 5 images and sounds are 
recognized and converted into text data in order to achieve significant reduction of the recording 
volume for comments on images. 

® Recording by means of character recognition 

When DSP 13 for signal processing control detects a character recognition recording 
mode transition command that is entered by the user via operation part 15, the camera carries out 
the same processing as that under <Monitoring of recording in image recording mode> in order 
to output the images for character recognition to the image display part. As images to be 
displayed at image display part 301 at this time, image 302 to be recognized, part 303 where the 
character recognition result is shown, and parameter control panel 304 where the user can 
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configure camera status and photographing conditions are displayed in the divided manner 
shown in Figure 3. 

[0027] 

Then the following processing is repeated while execution of character recognition is 
requested by the user via operation part 15. DSP 13 for signal processing control pauses writing 
to the image display buffer memory and carries out character recognition of said image. Once 
character recognition of the image in the buffer memory is completed, DSP 13 for signal 
processing control displays the recognition result in display area 303 shown in Figure 3. 

[0028] 

When a satisfactory recognition result is obtained, the user ends the character recognition 
execution command via operation part 15. At this point, the user requests that the recognized text 
be finalized via operation part 15. The camera records the finalized text on recording medium 
101 via memory controller 102 and recording medium I/F 104. If the text data are not finalized, a 
recognized image is rewritten into the buffer memory, and the aforementioned operations are 
repeated. 

[0029] 

© Recording by means of speech recognition 

When DSP 13 for signal processing control detects a character recognition recording 
mode transition command that is entered by the user via operation part 1 5, the camera carries out 
the same processing as that under <Monitoring and recording of audio during audio recording> 
in order to monitor the audio. At this time, as images to be displayed at image display part 401, 
part 402 where the speech recognition result is displayed and parameter control panel 403 where 
the user can configure camera status and photographing conditions are displayed in the divided 
manner shown in Figure 4. Furthermore, panel 130 may be configured in the manner shown in 
Figure 13 in a preferred specific example. 

[0030] 

Then, as instructed to execute the speech recognition by the user via operation part 15, 
DSP 1 3 for signal processing control receives the digital data converted by A/D converter 24, 
carries out the speech recognition processing, and displays the recognition result at display part 
402 shown in Figure 4. The user ends the instruction for executing speech recognition via 
operation part 1 5 when the speech recognition result is obtained. 
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[0031] 

If the recognition result is unsatisfactory, speech recognition is instructed again via 
operation part 15. When a satisfactory recognition result is obtained, the user gives an instruction 
to finalize the recognized text via operation part 1 5. The camera records the finalized text on the 
recording medium via memory controller 102 and recording medium I/F 104. 

[0032] 

As is clear from the explanation given above, the digital electronic camera of the present 
application example is capable of storing 3 kinds of files, for image data, audio data, and text 
data, on the recording medium. 

Displaying files in the form of a lookup table 

Figure 5 is a diagram showing a display format used to display a list of recorded files. 
When 3 kinds of files are to be displayed on the display part of the camera in the form of a video 
directory, DSP 13 for signal processing control reads the files recorded on the recording medium 
and displays index image 501 that represents an image file for images, and icons of the kinds 
indicated by 502 and 504 for audio and text, respectively, according to the types of file data, as 
shown in Figure 5. These indications may be displayed in the order they are recorded; or, only 
image, only audio, or only text may be displayed. In addition, when the user clicks on Erase 
button 509 after having selected an icon representing image, audio, or text using a pointing 
device, the camera erases the selected file. 

[0033] 

The respective icons 511 and 512 for audio and text that are provided below index image 
501 are used to indicate whether text and/or audio that is linked to the image is present or not. 
Text and audio are linked according to <Linking of audio and text to image file>, to be described 
later. For example, the presence of data is indicated by showing icons 51 1 and 512 using a gray 
level. Said icons are selected using the pointing device in order to activate <audio playback> or 
<text playback>, to be described later. 

[0034] 

In Figure 5, portion 510 of the screen is formed into a scrollbar that is used for vertical 
scrolling in order to show objects such as index images and icons when they cannot all be shown 
on the screen. It functions in the same manner as a window display tool that has been utilized for 
personal computers and workstations in recent years. 
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Image enlargement and playback 

Figure 7 is a diagram showing a display format used for an enlarged image. In Figure 7, 
when a single image is to be enlarged for playback, the user selects a single index image using 
the pointing device provided in the operation part and gives an enlargement command (for 
example, by double-clicking a button). Upon detecting the aforementioned operation, DSP 13 for 
signal processing control reads the compressed image data from the selected image file, and 
expands and transfers these to the image display buffer memory in order to display them on the 
image display part. At this time, display part 701 for the enlarged image, respective control 
buttons 702-704, and respective icons 705 and 706 for multiple linked sounds and texts are 
displayed as shown in Figure 7. 

[0035] 

When button 702 is activated using the pointing device, the image panel displayed in 
Figure 7 is closed, and the aforementioned display shown in Figure 5 resumes. 

Audio playback 

Next, in Figure 5, when audio is to be played back, the user selects and activates an 
Audio icon using the pointing device of the operation part. 

[0036] 

DSP 13 for signal processing control controls switch circuit 21 to connect the output 
from D/A converter 25 to the input of audio output part 22. DSP 13 for signal processing control 
controls recording medium I/F 104 and memory bus controller 102 so as to read the audio data 
and outputs them to the D/A converter at a sampling cycle for recording, and the audio is output 
from audio output part 22. 

[0037] 

Text playback 

Furthermore, when text is to be displayed, the user selects and activates a Text icon using 
the pointing device of the operation part. Figure 7 is a diagram showing a display format used for 
text data. DSP 1 3 for signal processing control controls recording medium I/F 104 and memory 
buffer controller 1 02 so as to read the text data, unfolds then into a character bit pattern, and 
transfers the text data of the kind shown in Figure 6 to the image display buffer memory in order 
to display them on the image display part. 
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[0038] 

Text display part 601 and control button 602, among others, are displayed in Figure 6. 
When button 602 is activated using the pointing device, the panel in Figure 6 is closed. 

Linking of audio and text to image files 

The camera based on the present application example is equipped with control buttons 
indicated by icons 703 and 704 shown in Figure 7 that are used to add audio and text obtained 
through speech recognition, respectively, to the image when the single image is played back 
according to the explanation given in said Enlargement and playback of independent images>. 
When icon 703 or 704 in Figure 7 is activated by clicking on it using the pointing device, DSP 
13 for signal processing control records the audio or text in the same manner as that in 
<Monitoring and recording of audio during audio recording> or in <® Recording by means of 
character recognitions This operation can be realized by enlarging, playing, and monitoring the 
image data. Figure 13 is a diagram showing the condition when speech recognition control panel 
130 is superimposed over the image display panel shown in Figure 7. For example, speech 
recognition control panel 130 can be displayed while it is superimposed over the image display 
panel shown in Figure 7 as shown in Figure 13. When recording image data and audio data 
simultaneously, or when recording audio and text while monitoring the playback result of the 
image data in the aforementioned manner, the image file and data to be looked up by the audio 
and text files are stored in [the same] file in order to create a mutually linked file. Figure 8 shows 
the respective data structures of image file and the audio and the text files within the file. 

[0039] 

In Figure 8, each file stores the numbers of linked files per each file format to be linked 
(the number of audio files is n, the number of text files is m, and the number of image files is k) 
and file identifiers corresponding in number to the number of files. When this is done, because 
not only the audio files but also the image files look up the audio files and the text files, 
correlated audio and text files can be specified from a single image file in order to play or 
display them without the need to look up all the files, as was the case in the past. 

[0040] 

Where audio and text files linked to a single image file are present, when said image is to 
be displayed, the linked audio and text files can be displayed in the form of icons (for example, 
at the bottom of image data) as shown in Figures 5 and 7. When the user selects and activates 
said icons using the pointing device, the camera displays the correlated audio and text. 
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[0041] 

Text is displayed in the manner shown in Figure 6. It is displayed independently, or it is 
superimposed over the display shown in Figure 7. In addition, when the user clicks on Delete 
button 707 after having selected icon 705 or 706 in Figure 7 using the pointing device, the 
camera can delete the correlated audio or text file. This operation means erases the information 
concerning the links established among the image file and the audio and text files shown in 
Figure 8. At this time, the audio and text files whose links are deleted may be present 
independently, or they may be erased. 

[0042] 

In addition, for independent display, the files are expressed in the form of a file lookup 
table comprising icons 502 and 504, for example, as shown in Figure 5. 

Grouping of multiple image files and linking of audio and text files to the group 

When multiple images are selected using the pointing device under said <Displaying of 
files in the form of a lookup table>, the index images are displayed with a bold frame as shown 
in Figure 9 in order to emphasize the fact that they have been selected. Furthermore, when Group 
button 901 in Figure 9 is clicked using the pointing device, a group of image files is created. At 
this time, the frames of the index images may be shown in a color different from that used for the 
other images in order to emphasize the fact that they have been grouped together. 

[0043] 

Furthermore, when Add audio button 902 or Add speech text button 903 shown in 
Figure 9 is activated using the pointing device, DSP 13 for signal processing control records the 
audio and/or the text in the same manner as that in the explanation given under <Monitoring and 
recording of audio during audio recording> or <© Recording by means of speech recognition^ 
At this point, multiple sounds and texts are added to the group. Comments on items unique to the 
group can be provided by means of these operations. 

[0044] 

Multiple images are linked to audio and text through the operations explained above. At 
this time, if reference data regarding all the other files is added to each file within the group, 
when this group is later specified, all the files have to be looked up, making management 
difficult. Thus, in the present application example, a group file for holding group information is 
generated when the generation of a group has become clear. The configuration of this file is 
shown in Figure 10. That is, it stores the number of the image, audio and text files that belong to 
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the group, and identifiers for the respective files. In addition, the image, audio and text files that 
belong to the group are organized in the manner shown in Figure 1 1 in order to allow looking-up 
the groups to which they belong. In other words, the individual files provide look-up for the 
group only, but they do not provide look-up for the files that belong to the group. 

[0045] 

When this kind of file configuration is adopted, group information, that is, files that 
belong to a group, can be identified quickly from any group, image, audio, or text file. For 
example, when retrieving other files that belong to the group from a single image file, once the 
group file to which it belongs is obtained, the identifiers of said files can be obtained directly. 

[0046] 

As is clear from the aforementioned application example, an image file can belong to 
multiple groups. When a group file is generated through the aforementioned procedure, the 
camera displays icon 505 that represents the group file in the <Lookup table of files>, as shown 
in Figure 5. When said icon is double-clicked using the pointing device, the files that belong to 
the group are displayed as shown in Figure 12. In Figure 12, when an Audio icon or Text icon is 
clicked on using the pointing device, the aforementioned <Playback of audio> or <Display 
means [sic] of text> is executed, whereby comments on/explanation of items unique to this group 
can be shown. 

[0047] 

To delete a file that belongs to the group, after the file to be deleted is selected using the 
pointing device in Figure 12, button 121 is used to activate Delete. Audio and text files deleted 
from the group remain present independently. When they are to be present independently, they 
are shown as icons 501, 502, and 504 in the lookup table in Figure 5. 

[0048] 

Also, Erase button 122 may be provided in order to erase the selected file when the 
button is activated. Needless to say, when deleted or erased from the group, the link information 
among the image, speech, and text data files shown in Figure 10 and Figure 1 1 is erased. 

[0049] 

In addition, to add a file to an existing group, the file to be added and the icon of the 
group to which the addition is made are selected using the pointing device in Figure 5, and 
Group is activated. Multiple files outside of the group can be selected during these operations. 
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Image files, audio files, and text files are present independently in the recording medium. Some 
of them can also be grouped together. Multiple files are selected using the pointing device while 
in <Lookup table of files>. A group file, to which images, sounds, and texts belong, is generated 
when Group button 508 in Figure 5 is activated using the pointing device. 

[0050] 

Effects of the present application example 

As explained above, in the present application example, a single image or multiple 
images can be linked to audio and text, and their linking relationship can be reproduced quickly, 
so that mutually complementary expression of the image, audio, and text can be edited easily. 

[0051] 

In addition, because speech or an image is converted into text, a comment can be added 
using a small amount of capacity. Also, a search can be run based on the text that is added as a 
comment, and it can be used as a keyword when generating a database. Furthermore, such 
processing as automatic data linking with information stored in another database can be realized. 

[0052] 

Here, the present invention can be applied to a revision/modification of the 
aforementioned application example as long as it does not depart from its gist. For example, it 
may be applied to a system that is configured with multiple pieces of equipment, or it may be 
applied to a device that is comprised of a single piece of equipment. Needless to say, it can also 
be applied where a program is supplied to a system or a device. 

[0053] 

Effects of the invention 

As explained above, because multiple image, audio, and text files can be linked together 
to allow the respective files to be retrieved and reproduced mutually so as to allow the respective 
files to be retrieved and reproduced mutually and quickly, the present invention offers the effect 
that mutually correlated expressions among the image, audio, and text files can be edited and 
recorded easily. 

[0054] 

Another effect is provided whereby because speech or an image can be converted into a 
text format, a comment (identification information) can be added using a small amount of 
capacity. Another effect is provided whereby a search can be run based on the text that is added 
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as a comment, and it can be used as a keyword when generating a database. Furthermore, yet 
another effect is provided whereby processing such as automatic data linking with information 
stored in another database can be realized. 

Brief description of the figures 

Figure 1 is a block diagram showing the overall configuration of a digital electronic 
camera as an application example of the present invention. 

Figure 2 is a diagram showing a display format used in an image recording mode. 

Figure 3 is a diagram showing a display format used in a character recognition mode. 

Figure 4 is a diagram showing a display format used in a speech recognition mode. 

Figure 5 is a diagram showing a lookup table format of recorded files. 

Figure 6 is a diagram showing a text display format. 

Figure 7 is a diagram showing an image display format. 

Figure 8 is a diagram showing internal file organizations when an image file and an audio 
file and a text file are mutually linked. 

Figure 9 is a diagram showing a display format used when multiple files are selected in 
the displayed lookup table. 

Figure 10 shows the data arrangement inside a group file. 

Figure 1 1 shows the data arrangement inside each of the image, audio, and text files. 
Figure 12 is a diagram showing a lookup table display format used for files that belong to 
a group. 

Figure 13 is a diagram showing a display format used when a speech recognition control 
panel is superimposed over the image display format. 

Explanation of symbols 
1 Pickup lens 
6 Pickup element 
10, 24 AfD converter 

12 Buffer memory 

1 3 DSP signal processing control 

14 Operation display part 

1 5 Operation part 

1 9 Pickup signal processing part 

20 Audio input circuit 

22 Audio output part 

23 Video output part 
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25, 26 D/A converter 

101 Recording medium 

1 02 Memory bus controller 
104 Recording medium I/F 




Figure 1 

Key: 1 Pickup lens 

2 Diaphragm-shutter 

3 Flash 

4 CPU for mechanical operation part control 

5 Mechanical system driver circuit 

6 Pickup element 

7 Timing signal generator circuit (TG) 

8 Pickup element driver circuit 

9 Preprocessing circuit 
10,24 A/D converter 

1 2 Buffer memory 

13 CPU for signal processing control 

14 Operation display part 

1 5 Operation part 

1 9 Pickup signal processing part 



20 Audio input circuit 

21 Switch 

22 Audio output part 

23 Video output part 
25, 26 D/A converter 

101 Recording medium 

102 Memory bus controller 
104 Recording medium I/F 




Figure 2 




Figure 3 




Figure 4 



21 




Figure 5 



Key: a Image 

b List of files 

506 Add audio 

507 Speech recognition 
Add text 

508 Group 

509 Erase 



qwertyuiopi 




Figure 6 



Key: 602 



Close 



22 



Key: 701 Image 

702 Close 

703 Add audio 

704 Speech recognition 
Add text 

707 Delete 



Figure 7 



( #Pfttt ) ~ -T03 



00 

^706 



j 0»t<* 
0 tf^77-fiva»OTf 



©; 



0 f*Xh7T-f*IO 



0 ^»Ah7r-f Jt-mOiMll?- 



0 »P7rf*, f«l-7r -f* 



on 



ran 



Figure 8 



Key: 1 Image file 

2 Number n of audio files linked 

3 Identifier of audio file 1 

4 Identifier of audio file 2 

5 Identifier of audio file n 



6 Number m of text files linked 

7 Identifier of text file 1 

8 Identifier of text file 2 

9 Identifier of text file m 

10 Audio file, text file 

1 1 Number k of image files linked 

1 2 Identifier of image file 1 

1 3 Identifier of image file 2 

14 Identifierof image file k 




Figure 9 



a Image 

b List of files 

c Erase 

901 Group 

902 Add audio 

903 Speech recognition 
Add text 



© M—Jtr'tb 

Q vsintot-.m? r < torn* 

@ — 7W*2«B«|IHf- 



( uj) ') >?&ftfc-r*Xh 7t l?T 
(13) f^.^y-f^mPBlft? 



Figure 10 



Key: 1 


Group file 


2 


Number k of image files linked 


3 


Identifier of image file 1 


4 


Identifier of image file 2 


5 


Identifier of image file k 


6 


Number n of audio files linked 


7 


Identifier of audio file 1 


8 


Identifier of audio file 2 


9 


Identifier of audio file n 


10 


Number m of text files linked 


11 


Identifier of text file 1 


12 


Identifier of text file 2 


13 


Identifier of text file m 



25 



@ JNW-yjT'-ffmMWf' 
0 yfr--fJ'r<fi,lQ>WfR- 



Figure 1 1 

Key: 1 Image file 
Audio file 
Text file 

2 Number p of group files linked 

3 Identifier of group file 1 

4 Identifier of group file 2 

5 Identifier of group file p 



w 

Text 


W W | 


a 0 1 








d 



Figure 12 

Key: a Image 

b List of groups 

c Close 

d Add audio 

e Speech recognition 

Add text 
121 Delete 



© 

m » 



' (JSC*}© 



C 



32) 



rmi 



Figure 13 



Key: a 



130 
132 
,133 
134 



Image 
Close 
Add audio 
Speech recognition 
Add text 

Speech recognition 
Execute speech recognition 
Finalize 
Cancel 



(19) B*H#ffFJf (JP) 



« 2 > & n ft it & m ^) 



#W¥7- 184160 

(43)&MB ¥fiE7^(1995) 7 ^21B 



(5i) into. 5 i^Jia^ ffrt^a*^ fi 

H 0 4 N 5/91 

5/781 C 

H 0 4 N 5/91 



*3t!f^ lSf*3i©§c4 OL (£13 J© 



(2i)fflgi*# 


fi«¥5- 328033 


C7DHMA 


000001007 










(22)ffilBB 


¥^5^(1993)12^240 




*S**H ETA* 3 T §30# 2 * 






(72) 


LU± age 








*S:»AHETA^3Tg30#2^ 














(74)ftSA 


#a± as mm 



(54) w®x-*;&tft^x-*£m-rsii» 



(57) [mm 

S^fewESjSft 1 0 1 fc , IBilffift 1 0 1 fcfg#j£ft 
fcW^T-?£^S&tS£5&f#2 0 3 fc. JgS&Sfut 

mttzmmm 1 3 1 , ^^^B^r-^&ic^ 
aj u strs^aj^a 1 0 2 1 * jwrrs - 1 




(2) 



WHPF7-184 160 



mt<m i ] mm-9 1 hpt~9 t *vmn\rc 

9 1 wm^x tali t , a^Bssrcs s «k o tz&m 
a&ff 3 c t mmt-tumm 1 t=iB«<oa«T-^ 

[ nsii 3 ] m iewpt - tmttix mm- h w 
pmmmmmmzmL, tmpmmmmmzi 

izmamzn 5 z t mmbtmmn 1 

[ii*ii4 ] mmmmmzmztifzmsi&T-? 
^r^nnst ixm^tm^mzmzmt, 

mfcm^<iim£T-?nwm&*3&ith zb* 

[ft^fffflSM] 
[0001] 

[00 02] 

ftr - ? fc - ^ (i^ JS'Jco h 5 •/ ^ t F M|BiS§ 
77? #f-£fE£$~tS 7 ^ — ;p K £ r? y b p-;U 

3 - k ttstt &*rc o , tmcommz-o^x coim 

[00 03] 

mwmmi£ob~tmm$A upl&^ m 

mh, x^)V\fr*7 -v YttX\i, ^P)-y 
lift h5vm tiRBtt 4 mP h 7 "/ 9 £*g^C£ & 

i> tzib ummm »x-$> & x * ^tt^ ?n 7 t°-±« 



Y=/-;9 LXQXn^P h?y9 £?}£ 
L . #HS L V M b 5 >y 9 £ J.O ftffi 2 £■ Ittllf^ 
-f if^B#fS Z&m b^h tztbMtm < 

[0 0 04] : UPh7>y7frt>i±—?0M&L 

frmmx*^ %^cox\ mm^mmxh 

mzxis^budx&mitz* 

&mb-t&cDT. mizMmzmi^phy «/ ? izx 
ti?zbi±3z vmz&x^mmxfohb^o mmm 

[000 5]^. IMLtz^cOfi^^^m^^y^z 

&mmz{&b&m&&xi>fc&, fct. *%mn±.m 
i tzmmizm&x ^^ntzh^xh*! . g w t -r s 

■ft. W^. T^fX h 7 r >f ;Ma-C«Offli:tRBltt«» 

[0006] tt:* iiPfoh^\mmT**Mmz 
m^x^^tzm^mtxmm^mi mwmm) $ 

m^m-fhzbxhh, tfz, mibixmziitz 

b % <n*-v- h b ixmmz, z 1 1 «rt^ * 

/:,r ^it-:'iiirer-7 ^»I^I>^S^fif*t-|> i b X 
[ 0 0 0 7 3 St, ffi«r-?<-xtfSttS^ffl# 

t ^PbIT" i »w t T- ? £ u y 7 -r s t£ b b ^ o mm i> 
hzbxhh. 

[0008] 

mwtwmhizwmvi m.^wmw^, s 

? £ 9mt h %mi mm f- 9 1 ^p f- 9 b mm 
^nxmkthtztbmmmfcb , mwmmmzmm 

tz^pT- 9 mmt i mm- 9^7 r 4 Mm 1 1 
xmmtz mmm t , mmmm § ^b«t - 7 &m 

[0009] if i Kimsm9tT-ffrt>J& 

m&zmoxmmmzmzmi. uxftsm- 
mzi hwmmiT* x V7r^)Vb Lxmumm. 
v%pff)&r- 9 b £$m-3ftx mm l , fr^mmx^ 
txoizwmm^iozbmmbLx^t, ttz. 



(3) 



WHPF7-184 160 



mm^mmtzmu m^pmmmm^mzi m 
T-? t mm^nxmmt , tnimv* i j 3 1« 

lUtSSfcfi^ c: fc &«Sfc LT^S. 

[ o o i o ] tfz, &&L<&mmmm3mztL 

ft, atfanafitiBt*-? < fris^T-^^isiis- 
n^ts^fc^afc LT^S. 

[00 11] 

[fffl] I4±«J:ofc, i«^W»SH«x-^S 
VW^r - ? £ 3 tiX ^ h <VX\ 9 

=Sr< fc i l^LrJOMI. f^b^7r-f^ 
Iff) U 7 7#*n]1fifc & 0 , ^ft/Nitf)? r JiVkWrt* 

t>mmzmm. m±x%icox\ mm. #r 
imx'%&, 

[0 0 12] W?*&SW±iMlST*XbJfc*fc 

s. St. m<VT-?<-^zmztifzm&t<vmx' 

[00 13] 

-C&S. Hltfc^T, IBIMftl 0 lte, fflitfPC 
MC I AHICIIL^ty^-H^vFfU? 

mim-T <*z/w?foh\ mx v-tix-h s . a 
Mm^mi-mux\ D/A«2 5ii, ft^» 

IMfflfflcpu l 3*»4>3@i^>jiST^;i^f^^-i& 

1 9 , fiwi0j»fflD s p 1 3 . mm^m-y y r 
7^ y 1 2 . $mtm 1 /f 1 0 4 «^-c«n«r 

[0 0 14] D/A^«2 6(iB«H*|i^'.y7r^ 
t'J 1 2*^«rV^7««T-^^T^n^Wifi^ 

«£^»ff^£«fc LT^t-S^S^g-C 
& 5. mSg^yX-Cj, >9 , 2(4S£y«fc7^y7 
H«^3te£IKy*ffli^-y7-, 3(4Xr-D*\ 7 

*>mmmmmc p U4 (4»««&fi#£fT& 



[0015] mmi-bmmm-^mmitnmt 
mz^mtzcc dx. 9i 5 > m°?&'+.i!!ifS7{iis 

tt«^ 6 * iftfN§*Sfc«>(Ci^=5:^>f 5 7 Xff 
fcTS (JiTK r T Gj fcfjrfS) . IffflilW 

9 Jig«*? 6 tlttS ffiTl 7 XBfcfeCDfcfctf) C D 
s ®&W A/D$&m tff 3 #B^iMtMM£fl;t 
£. A/D^^l 0!itfrMffiaaWT-7&r^7;l' 

taaft-rs . ft^ii0j»fflc p u 1 3 (iff ^flui&s: 

$IJ«"t 5 fI^»IPJ»ffl DSP ( D I GTA L SIG 
NAL PROCESSOR) TS> *} . JSf^lSSaB 1 4 

x\ &ft&i5tetrX7%!mfrt>m®t&fciib<7)*- 

sK- K^TJjSirCft -6 . IE««* I /F 1 0 4(4* 
»fiM(;^^'< fy^Hf*^ 7 fctBSSf* 1 0 1 1 
iHfc - - - > n Qtt'¥iti r^Ktu . ' 

t . *mmmm 7 5 «iaii«*^otB»7 7 a ivy t 

[0016] Bffift^fflA 7 7 r 7 =e y l 2 (iff 

imm s p 1 3ipt>wxmKT9±xth ztiM 

»^;P£f8Ht£ i fc I . 1 5 (c b 7 

3 y t A - ? fctj (t I. sjf >f > t J > 7ir>M x Srffll, 
GU I (Graphical User Interface) tffiOa-f- 

D S P 1 3 iflff^^ffl^' 'X 7 r (7_«| /? & 3 7 h 

v L T sK-f 7f ^ 7 7"rV <>f X ( i b 7 
■v 7*-/L ) t J: r,xm- -ft Z t Xl)*7(r)fo^h 

mmmrn t%z>„ t tim^wmmm d s p 1 3 1 j: 
■o t . Bf«^r^7 h %m&mm&$&£.m 

t&Zb X JL-if- 1 ^ L T S# S fist Bffi , ^ 7 7 O 

, ie»«ft±w 7W ;^ii'it n% zmz 
m^mm^m^timbtii . ^mmmxtmnmm 1 

5 fc±HG U I S jl— f- I /FJiff^tlftgP 1 5 
t ± 5ftf^ t «rf 4 - fc fc -T4 . i fesK-f 7r -f 7^"r 
A>f x t J: 4 7 U -y 7 & ^> \m 7" 7";b 7 >J -y 7 S^^r fc" 

^eiMi#fc»-rsifct-rs 0 
[0017] <mmm^-mmmmm^-?> 
m^wmmmD s p 1 3^— f-emmi sota 

K»fff8NS-£*!*irt£ fc . fl^SMWfflD S P 

1 3 i±UT«Masr LiE«rr mmm\m^n2 
3 tc^ts . gfM«sia(;j£ txuyx^mw^ 
7 *^gp$Mfflc p u 4 tav'7 tmmm 5 1 i 0 

tf-biL|, : ;7)Ff:. ai^ftt'fc'^f^l 5t«*$ 



(4) 



WHPF7-184 160 



? - 2 cos o mtw^ •* »/ t- f «f-^ 

£ JM^IMffl CPU tTUffi'tS . * tfgfHUffl 

tPffl c p u 4 1"« & $ *i£ffl s . x %%mm 
diss tj; & . sfe £ » 

*0S# cotf^tloTii.xFn*'3iBBK£ 

imitwmftffmuyx i 

y^ >y ?-2imm?6'\<?)A&im.£itmth 1 1 

£1^ J: 5 ttftfefetiHt^T^ft. am* 
^ 6 i± , T G 7 ^ coffin 2r 8 (c J; 
T^I$^lMMt^fc±01M^«>» ffi. TG7t± 
ff^IlMfPfflD S P 1 3 «t 0 -ccOijf^fMfflisflT 
V^o «±cOi 5 tLT»£^ltftSi7 6c0ffi7^f2 

; f*^wai^t=ii4'ti.ffi«/>fx^iifei'tscDs«i 

Sfc&K, A/DSSH81 ocodu->^ (rj^/WfcS 

fu affiftwia 1 9 1 ± -a tiwi3^-^y 

h h"r * ( ffl i. if MUKfi# fc 2 feUlt^R GBft?) 
* y r? y l 0 2T1ifiWIfMWfflD s P l 3 

[ 0 0 1 8] 02 (i, asiiaia^-Htfctts^^ 

Sr^ia-CftS . B«H^ 2 3 tEfJ^j §tiS^B« 
u-u;Ol::: -i. : I. j fci!*W!^:^|R«*fr2 

^rt^^-^ay hn-/l^;M^-2 0 3£#3"J 
SilT^SflS. BlUH^^r^U 1 2c0r 

vmmmz&mimm u&i 3 jj ^ . * 

«^S52 3T'H*$fi|, 0 JL-if-{±, 

4. 

[0019] ± 6 t ±oTi 

t ^titzwmmmim^m 3 s 

t. 

<mmmm>mmmm{fm 1 5 &$ij»ti> z 1 1 i 
19^^ ^t=JW*#g^-s t , ff^Ma$ijfflfflD s p 1 

fitzmi&r-f^zAfJziyYu-^itLXr^^x 

Lxr : J^)v<r>&mmm -> m.. ss^mi. f 1 
0 4 £ it ixmmw 1 0 1 izmm-tz. . 



[ 0 0 2 0 ] io«EiM«r B myiB»i*Ta-s«r E i]4i^ 

ty/tt3yhn-5 1 0 2imim^W^v7T* : t 
U 1 2A.o*^}X^^f?i:tix{flB«-ri=Bffi^l|i±§ 
irC Wilfrid Blzm^til ifota-f-^ 

So tfcSfM. ±9«<fBfi£ii^B««tW&«i£ 
•t&tziblz. mmmfflfflMD S P l 3(iJBiL£:Bffi 
ofSEI ^BftS: Ei§7 r -f ;H=#airt5 - 1 h . 

mm. jtmm *18W 1 gstmiK^Bm* 

#JPLT t7r^ t*«SD L^^tDTS) 

[0021] <mpmmmp^-^Rmm>m 
m-mMtm^wmmmD s p 1 3{±^^ -/^m 

K2 lT : t^A77lllS§2 0c0tB7l& ; t*ai7]i?2 2«A 

ff^^JiSlJffllfflD S P 1 3 *fcL— rtO^SS 1 5 fci § 
H^EMfitf'iTrfs)B-;-^t. y^OT^JWHIDSPI 3 
teA/D%W%2 4X'T : J?J\sT-?l,zmiltZT-? 

l^8E*I/F104t:ls^-f5. 
[0022] flflliafflD S P 1 3#JL~f-<?)« 

^(iftwiiwfflD s p 1 t 

T-#^l£»cO»?^fc * & L^Bf^T'ff WWIfflD S 

p i sii^jzcDimzmTth* 
<mmt%pcommm>m®Lt%p$:mmi l ztmi-& 
m&co<mmmt>Tmwuzi i izmms. 
mixmm#i/F 1 0 4iz&mix^&mn. fi-f- 

»fI$lJffl)fflD SP 1 3{4A/D3ESWB2 4*>i!>Stt]Ro 

tz^pv>T-9*\i^mmmmv sph cora&A. 7 

fitt?f^r» I/F104 tISiltS . N 
TSC^CO 1 7 —A mffll 6.75 VfpVoh. 

mffimmt wtu 1.45 ysfian^ 
7 y * y ^"Mfa t <- wifefi-f-*s#4 L^iPi^ 

^ ;coan:7'7y^y^"W B l^^^B#r s l (»i 55 
y # ) corg tMtff ^mh^ ixr c ^ fltf- ^ 

^tLSr^ffl^-§t^tft 1 OMBy t e/s e 
c oxt- YVt-? Zffikth . 
[0023] ^Pt~ 9 £ 1 -fyy°)V- 8 b* ■/ 1- X 2 2 k 
HztWJ y/tS t # 1 6 . 7 5 m%V>T-9 
§*(4»3 7 0Byte-Cj)5. dWr'-^^SOW 
1. 4SW-T'feIt«^J i l260KByte/s 

e c cote^xe- k*^t*i> . ztL^mm^- 
vn. mtmsmfat ltpcmci Ammzizm 

[0024] tl±IMBH Lfc i o t , 1 HfflO?Sa» 

mmuzmmm m >mfflzmtz> z t x-^mmm 



(5) 



WHPF7-184 160 



[0025] ttz^pT-fzwim^co^ryy* 
>ymm\Hiz<&mLxi>&\\ mm. 44. ikH 
z. xri^. st^h^^rt^^yryy^-f 
& fc # . l ®<7)*¥7 7 yywm ( 1 h HUH) fit 

If 6 By tett<(±4By te«0f?f-?£!ti- 
fE&'tS. iaii«*fcLTHDD^i;-«IS«ffi 

*H y?-y-7"£ti£ i 3 tiss-tsw^v^, ¥ 

* y <o*^ti±B#r-^ t #^t-.? * 1 h@ 
cm y?-v-7z-£s>iismte%< , 1 7-( -/i. Fiura 

(lVlffl) «BftT-^«tfft^T-^^ieii^iL 
I. i a 1 vft?M y?-y -7'lE»<r LXh^K 

[00 26] <T^f X hr-^WlE»>*»i»*^ 

<*¥tmiz x h w$>mmmm dspi3# 
m^immt t tit yit<mimmt- m^m 

b«i±, m3coi:nztsmixdttmmo2. % 

ZimZtit:&M£&Ftl&ft3 0 3 , **7<Dim 
WWtkfr & t" & i— f - *&K5^-^<03 
y b n ^ 3 0 4 =Sr t" £t>»'J LT £ . 

[0027]^ ix^~^~mim 1 sti^tx? 

SSSSHfr L -O vg, ffU(iI4T?«I 0 . ft 
U * frit t T -e cOHfl K*f LT^ISli^ 

a^f 3 . a . y 7 r * * y ±«b« t^t-^^irsMi 
8#»Tt6 £.i$*m&fflWRiD s p 1 3t±-^fsi»£ 

* & 0 3 t^H*#W< 3 0 3 ts*t s . 

[oo28] ^-^m^mm^m^iifz t z. 
bx-mm 1 5 1 j; ^xic^immncom^mri- 

xbi^'jayhn^l 0 2. IBilffifti/FlO 
4 £^ LTieiiffifr 1 0 1 iztm-fh . r^x br-^ 

[ 0 0 2 9 ] <^mmzi m»>immmmwm 
d s p 1 3 &3.-if-cr>mim 1 5 1 ± ij^wi 



2. ISfi*ff^-tf-^lft£T^ !> 

A^-^nyhn -/^ U-iV 4 0 3 % fc" *m\ LX 

1 3O0i;5tliJ^T"#l>o 

[0030]^ LX jl— f-^'Sffg|5 1 5 tiitf^ 
iSli^T^^LTV^^ff^aMtPfflD S P 1 3J± 
A/ D ^BtH 2 4tf^Ar-^l:^iLftf-?S 

gttffiy. ^igiiMa^fi : ^fSii»a&H4^ssE 

4 0 2 £$i*rt& . i-f-'-!iW^Oiriife*A^^ix 
t ; ^Tf*#ai 1 5 1 J: oTWmrii»T«^&** 

[003 1 ] g I 1 i S ■ r 1 + H , rf : JWtSSf^ 1 

5 1 j: o x ^msttsiff s ^s-r s „ isjii- s t gufes 

##^fi^ £> -I j^Ti— tf-(iS^i5 1 5 1 J: -o T 

titzT^x h Sr^^E U uy 1 0 2 . I 

/F 1 0 4 £tf LTIB«*Sft£iB»t*. 
[0032] lili^lMt j; i3HH^*«Sri 3 C*S»I 

T^^hr-^^3fflS07r^^&«fiFt"# 

-mzm*i-&mtftt**-tmx'$>&, 31^77^ 
i: s «ifiWii£Wffl d s p 1 3 mmm&txzwm 

*iT^47r>f/^R»ajL, 7 7^^^0811: 

^fHI-^sK^IPimso 1 . '.I ■!..',.• •• . 1 

2. 5 04(?)J;a=5:T^ayfc lX$k^i~t. Ztibft 

m^mmmmmzmitzio . uptz 
>f -r > ^xmmuznh, m^9>5 0 9 

S: 9 y >y ^ -tS b fl * yliWiRZ titzVTA iwm&k 

[0033] m\W^^ 0 l<7)Tmzfo&^P. t^X 
hco=kxcr>TJ3y5 1 1, 5 1 2I4* fioB«7r-< ^ 

■tt:itxni><n?$>&. T^M-&.u^pmmtt<m 
«7r>f;i^oWR r^fxbwyy^yt^-oTyy 
Miff, 5ii. 5i2oi5tr>f3v* 
yis-isKfwz-tz ,i b x'T~9tmm-h ,1 1 £HJg 

i-S. ^n^cor-f^y^^yT^y^r^'^x^ffl 

[0 0 34] 05tfc^T. Bffi«-SP5 1 0(±^-f 
# ^^^t § lz^tLt> ZffimX'% %>£d tiTtx^n 
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<Mffi «A$.tffi£>0 7 (i . ffiA£ ix/L'B^H^ 
?FM£Sf 0T* & o 07 tfeUT-otoHfit-J^T 

mm s p 1 3te±m&fc$mtti tmmztitzmm 
7 r -i tifrt,wmm-* i . wn-cwi 

i«fc Miff 07 t^f I 3 KSfcfcSfi*: 

B««H^gP7 0 lfc#0J»ffl*'?y7O2-7O4. 

j^yy^^sa^w^. f^fw^yH 

?^7 0 5. 7 0 6&fc^flS£i(X& 0 
[ 0 0 3 5 ] #A >f 4 yv'T^A XXif-9 y 7 0 2 Sr 
jBirt S fc El 7 £ US 5 *ut Hfl W t*;H±B1 t iiT 

[0036] ftwi$ij»fflD s p 1 3 \txA -^mn 

2 1 £0JfflLTD/A«§2 5*>^aj^Srt^aj^ 

2 2 <oa* tsatts. o mwmmmm s p 1 3 1.± 

lEfiffifld/F 104, >tiJ;tt3^bo-51 0 2 

ft*. 

[0 0 3 7] <r*Xh<3B£>S£, T^XhSrHS 

zm^zT^zhTj ayzmvuxmmtt, H7 

JI0J»fflD S P 1 3 IJfEUffitt I/F104^t'M 

ffi t * * 5 ? 7 b* >y b ; ^ - y sifi t x m 1 6 

[00 38] 06T'(±T^X bc?>^SP6 0 1 fcftjfflffl 

$7 y 6 o 2 & fc";ms£ii£ . #4 yf 4 y WW 
xtt^y6 0 2 -zmtth tmemw^Mimtt, 
tit. 

<m&7 r a )^\^pmff^7.Yco') y?>^mm 

>xcDmmiz^x-mm&m*kitzt%. mmz 
mlxjMp. m&pmmfcx &7-*xh 

fr 3 tz 46(7)3 y V X3-)VX7 y £07 iz^tT-i =1 y 7 
03. 704^«ffi|^T^S. Wyf^/fAM 
XT"07tK)7W 37703, 7 0A*9Vv9Lim 
-fl fc ffWIfflfflfflD S P 1 3 ii^* <^IB#|B#« 
f^t-«l/Sg>, <Wmgti£J:&tSI§>fc 



-^teAS^'W^t.^-^!* £ fc i oTffi - fc 

#t & s . 0 1 3 «. 07 m&m> <A7W)±i,z^p 
wm&MWMrt*fri 3 0 zmfaxm^ttzM^^-f 
mx'fo&„ mm. mi3co£o\zm7<nw8&7sm* 
)icr>hiz^mmmmm>^)i 1 3 0 ^fi^-cust 

£ i fc ifX' % h . Bffir - 7 fc W^r- ^ & mmm 

sf^^7T^ /pfr tsttf § iticio xmmz u 

y7^7r^MW„ 08 (i. 77 A }V^7M$k 

7 T A )VmtnP7 7 A )Vt T^-X h 7 7 A JV^*<F>T 

[0039] mS{Zi6V>X. 3:77777 A MiVy?^ 
tih7 7A /Hit;" fc lz U y 7 § titz 7 7 A ;H» ( 
fp7T^ffin. fWb7r^/«m. Bfft7 

r >f /bS* k ) r >f /^cojtG ttz 77 A iW%m 

7>cDmm7 7A!i<frhrmzfiz>%p. t*xy-7 7A 
>nm^ix^co77 a ^m^ht^im^ttzt 

tfX'Zh* 

[0040] -^7m%77rAMz^y7%fLt^'P. 

Bfffc) ^-ti»ifc^T"#s 0 — — \m<7)~TA 3y 
*sK-r yf < y?T>u xxmtR, mith ti]*x\t 

[004 1 ] v-^XYime^koiiZm^Kh, ZCO 
T<>mm„ itiiMS. hi - .-A i>. ■ • i ' 'iu.7 K \ - 

%tit„ t fz j-— f -am 7 1 a ta r? y 7 0 5 . 

7 0 6 £*M >f -f y^'rVW XT'SKfc^fA. HOHiitf 
^y 7 0 7 *7 U >y ^-fS fc*^ 7\m)^\lhtltz^ 
P. T^X Y 7 7 A JW)Wm^7 3 Z fc ^t£T"$> S . 
;^if^S(±08tSfc^Bft7r^^. f^f 

^ h 7 7 A )wyam wjy? timzmsi- 

£ 'J y ^^ffll^^fLtW^T^ ^ b 7 r >f ;K±*?*T 

#£t««t5tLTfc i^fc. fff*t-|.J;3tfcTtJ; 

[0042] tti, *Sft-e^§*S(c«, 05tfc^ 
TT-fny502, 5 04C97r-f ^-K^Wi 3 1 

ffR x^^b<?) l Jy^>ffMiO<7r-f/^-K^ 

>tfc^T , KA yf A y7T>\A XlTZX-yX^WM 

mmm&tmiMmmmtitzzt mmtt i 

-fyr-f y^T^WxT"09tfO^-7°{t;^^y9 o 1 
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2- ? >J >y ?f 5 fc Mft7 r 4 ;l^7P-7Wj££ii 

Hft^ftW-fe i: £3r 5fe Hi" £ £ fc "C # 

4. 

[ o o 4 3 ] , «yf^ y^T^'-f xtH9 
•fW^#JD#^y 9 o 2i>h\,mupf*z hntnx? 
y 9 o 3 fcjSirts tff^iiMfPfflD s p l 3 a** 

jD^iiSitt^-g.. z tvmmz iit ?>-7°t## 
^mm^n^immm^^i &zt h , 

[0044] «±IM!UcSff^ J: oastfrafttw 
cr>7 r A Mz-owx ztiW\-co-£x coy 7 A Mziftth 

tmmztth . * ; r^MtMtii^vL -7^*42^ 

yyrAivkmfth. :co7T^/«t±, 01 o 
tsffiat^s. w*>, 7'^-ri<zmi-mm. % 

P. T^Xh^c07rA)VcoWm., Mf3%W7rA 

-eo?>-7 0 tJRt~& 7 1 A )\^cr>$%k\ifth*£^. 
[0 04 5] ZCO£o%7'}l-7°CD7 T J /immzX 
*} , 7')l-7\ WJL ffR r# x b , i: 07 r 4 

^t- h fji-rmm-t^bibf^-rizmti 7tAiv 

*-m\zn%X% h . ^Rlf-ooBft 7 r 4 

mmt?)v-T 7ta mmn ixn tmti^ 
7ta fwmm^mmm^ s . 

[0046] m±IMt^MftTO^Bf3^,^J; 3 

«7t>( MiWk<7)y)v~y\zmth z t *fsjirc*» 

6 . ±3&D^JI£ J; TOL— 7°7 r 4 Mms&tit, 
h.^^y\i<7r-i)W)-mm>kziiv^x, 05771; d 
dT^-^ r A lVZ^fflfthTA 3750 5 

l, . #A >t a yff^A xxzcorA zyifffr? 

V>y7-t&tmi2Z>£o liZ?)\r-7liZ$it& 7 r A )V 
im^iih. Ml 2tiSWC, gp7^7, x^fX 

i-tm 37^w yTjyy'T^Axx? y lts 
iHTh.(f^«mi£ttiiD»<ff^^B^>. <^x 

[0047] Tfclfrf &7?-f /l^TOlz-T*^ 
9 Bfrt 4fc*>KI40 1 2 fcis wCHMfrtS 7 r A)V^ 

a >t a y?T^A xxmm Lfea, t'^y 121 xm 



SJ;3t-fl=t^(iEI5tfc^Tr-f 375 0 1, 50 
[0048] ^/-:il£-t;'7> 1 2 

>i t xmiK^tirz7 r a /immx t j: 

HI 0, HI lt^SfLS ^1^7*7 T>f/K ■ 

mpf-^x }-T-?7rA)vt vm<7) ] )y? wniz 

[0049] ±tz7TA}V*mf(n7)V~7lzmZ-htz 

mz\m5 izaux urn h 7ta )vx.vmt h%&?)v 

-T7A 3 y*#A 7f < yfr^A XX'WRLX^lV 

-ntzmm-th . ztt^mmza^xyiv-rm 
o 7 r a Mmmmm-tt z t mmxh & . mm# 

atsmX'MM7rA fl-^ "§P7tA)V. T d fXb7r 
A Mffi&th . Zil t>ff>\\ < //P-T-ftt 5 i 
f:fc^Ti&CftS. <7T^W-I*>tfc^t^7 
r < y 7-rV <A 7. \zi. o T flB&D 7 r i Wi* h . 

s fet^>f >t -r >?t>w xxm 5 m<7)?Ji>-7°frx 

77508 ^filH-s ; fc T'Wft, W*, T^fX h*tH 
■fh 7~)i~T7 t A ;^Mt§ . 

[0050] ( xmmvm ) w±wm i ^ x ? t , 

^atWfcfe^tti. #-7)BftX{±^a7)ilfti:, W 
r^fX h H<7) 'J 7 ? *JBIffit 5r ^(7)'J77S^ 
B8flSSffiitW[|TSS«DT, lift. f^fXbO 

[0051] ttz^phi^im^ir^x hiizsmi- 
&tztb'j?%:^®M.xmmzim*tttf& z t & . 

[oo52]^ t^mit. zamwifflLizuvm 
x'±Msmmmz®£.mm itz h wzmm&x-h 
h„ mm, mmmm^m^tii^xTMzmm 
Lxhi^m&t>f&mmzmmixi>&\\ t 
tz. y7^Ti±m±mmz7uyy^\mt&zuzk 
o xmkn tih msiz h mmxz iztn^dtxh^ 

[0053] 

imm%i yjMwiteioiz. xmizztuf. 

'J?%<ti>l^J±com&. T*xhcD&7rA 
mco >jy? mm b % 0 , ^ -f fiw 7 r >f IV £ 

frbimtztim. ^x%h<nx, mm. mp. 
Y7ta n-mx-commzmmacD h i mmmmzm 

[0 0 54] ±tz. g^^Ulfflll^f^XMMC 
S»T^I»^>=5rV^ST'B«KaiR (ISS'J'fflg) £ 
#W - 1 4 Jit** 5 * So 4 , t LT# 
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■mt^mdfihh. set, i«f-?^-xi;a 

s. 

[03 ] ^S^-Htfettsas^^StHT* 

[04 ] mm^-vizmim^Bm^-tmTJb 

i. 

[05 ] imztitz? r 4 !v<7)-m$k^m^^tmx' 

[06] f^b^asjese&srtia-e&s. 
[07 : mmm^mi^i-mThi. 

[08] mmyr^^t, ^pyr^ivm/^xvy 

[09 ] -KH^t^v^a^7T^;^'«R$^ 
^O^ffM&*t0T"l) I) . 
[010] ^/P-T7 r -f /KQftfflf- £ o 



[0in *p, f^h#7 

r >f ;UOrta5»T-^»R£5?rH'C* 5 . 
[012] l> 7r^f ;UDHtfl5j3B3££ 

[013] Mffi^sffMoitwMriiiM^-^&fi 

i st^yx 
6 mmm? 

10, 2 4 A/D^Jt^ 

12 ^77r«U 

13 ifWWfflDSP 

14 fiffft^gP 

1 5 tsft^S 

19 Sftfi-^JfgP 

2 0 ^A7J0B 
2 2 W^ai^gP 

2 3 B^^aiTjgP 

2 5, 2 6 D/A^j^ 

101 Efts* 

102 ^ 'jA'^^y 

104 tsmm/F 
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